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ABSTRACT 



[Abstract of the Disclosure] 

A method for motion estimation combining a one-pixel greedy search algorithm 
5 (OPGS) and a hierarchical search block matching algorithm (HSBMA), and an 

apparatus therefore are provided. The method includes the steps of inputting a frame 
in units of macro blocks and a search area and estimating candidate motion vectors for 
a macro block and a search area and estimating motion vectors for a macro block 
desire to be estimated; and if an error of the estimated candidate motion vectors is in a 
10 threshold range, estimating motions in a search area which is smaller by a 

predetermined amount that the previous search area, centered on the estimated 
location, and otherwise, estimating motion in the whole search area. 

[Representative Drawing] 
15 FIG. 2 
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SPECIFICATION 

[Title of the Invention] 

Method and apparatus for motion estimation of hybrid type 

[Brief Description of the Drawings] 

FIG.1 is a block diagram of an apparatus for hybrid-type high speed motion 
estimation according to the present invention. 

FIG. 2 is a flow chart of a method for hybrid-type high speed motion estimation 
according to the present invention. 

FIG.3 is a graph showing the distribution of macro blocks by motion vector size 
obtained by performing a full-search block matching algorithm (FSBMA). 

FIG. 4 is a conceptual diagram showing estimation of a candidate vector in the 
previous frame and next frame, according to FIG. 2. 

FIG. 5 is a conceptual diagram for a one-pixel greedy search (OPGS) algorithm 
according to FIG. 2. 

FIG. 6 is a conceptual diagram for a hierarchical search block matching algorithm 
(HSBMA) according to FIG. 2. 

20 [Detailed Description of the Invention] 
[Object of the Invention] 

[Technical Field of the Invention and Related Art prior to the Invention] 

The present invention relates to a method and apparatus for hybrid-type high 

speed motion estimation for application to a moving picture encoding apparatus, and 
25 more particularly, to a method and apparatus for motion estimation combining a 

one-pixel greedy search (OPGS) algorithm and a hierarchical search block matching 

algorithm (HSBMA). 

In general, international video standards, such as H.261, H.263, Moving Picture 

Experts Group (MPEG)-1 , and MPEG-4, have been adopted for video services, 
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entertainment, digital broadcasting, and portable video terminals. A video encoder for 
generating a bit stream according to the international video standards compresses a 
video signal using a motion estimation algorithm. 

Existing motion estimation algorithms include a full-search block matching 
5 algorithm (FSBMA) and a fast search algorithm (FSA). The FSBMA first obtains 
differences one by one between all possible locations within a search area in the 
previous frame, and then finds a location having the minimum error. However, though 
the FSMBA is the simplest and idealistically accurate, the FSMBA requires a huge 
amount of calculation and therefore is not appropriate for real-time encoding. 

10 Meanwhile, compared to the FSMBA, the FSA greatly reduces the amount of 

calculation at the cost of less accuracy, and is appropriate for real-time video encoders 
(for example, video telephones, IMT-2000 terminals, video conference systems, etc.), in 
which video quality is relatively less important. Examples of the FSA include a 
hierarchical search block matching algorithm (HSBMA), a three-step search (TSS), a 2D 

15 logarithmic search algorithm (LSBA), and a one-pixel greedy search (OPGS). 

Here, the HSBMA has high accuracy and is relatively less affected by the amount 
of motion, but involves a large number of calculations, and requires a memory for 
storing low resolution frames. Also, the HSBMA requires a large number of 
calculations both for a long distance motion vector and a short distance motion vector 

20 without distinction. 

The OPGS algorithm can find only an effective motion vector near a central point 
(or a starting point), may incorrectly converge on a local minimum point, may not obtain 
the correct result in a complex image having complex motion, and requires a large 
number of calculation to find a motion vector over a long distance. 

25 Therefore, existing motion estimation algorithm cannot utilize the already 

calculated results and an opportunity to reduce unnecessary calculations, because each 
of these algorithms is applied uniformly to all blocks, regardless of the complexity of 
motion, and regardless of the characteristics of a subject block. Therefore, existing 
motion estimation algorithms can be properly implemented in hardware, such as a very 
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large-scale integration (VLSI) chip, but it is not efficient to implement the algorithms in a 
software-dedicated encoder. Also, an inexpensive price, low voltage central 
processing unit (CPU) cannot be used to implement the algorithms in software due to 
the large number of calculations. 

5 

[Technical goal of the Invention] 

The present invention provides a motion estimation method in which 
unnecessary calculations are minimized and accuracy is enhanced by performing 
hybrid-type motion estimation combining a one-pixel greedy search (OPGS) algorithm 
10 and a hierarchical search block matching algorithm (HSBMA). 

The present invention also provides a motion estimation apparatus to which a 
motion estimation method combining the OPGS algorithm and the HSBMA algorithm is 
applied. 

15 [Structure and Operation of the Invention] 

According to an aspect of the invention, an adaptive motion estimation method 
comprises: inputting a frame in units of macro blocks and a search area, and estimating 
candidate motion vectors for a macro block desired to be estimated; and if an error of 
the estimated candidate motion vectors is in a threshold range, estimating motion in a 
20 restricted search area centered on the estimated location, and otherwise, estimating 
motion in the whole of the search area. 

According to another aspect of the invention, there is provided an adaptive 
motion estimation method, wherein a zero motion vector, a median of motion vectors of 
neighboring macro blocks, and a value estimated from the previous or next frame are 
25 generated, and a candidate motion vector is obtained by selecting a value best 
matching the macro block desired to be estimated, among the three values. 

Preferred embodiments of the present invention will now be described with 
reference to the attached drawings. 
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FIG. 1 is a block diagram of an apparatus for hybrid-type high speed motion 
estimation according to the present invention. 

The apparatus of FIG. 1 has a candidate vector estimation unit 1 10, an algorithm 
selecting unit 120, a motion estimation unit 130, a memory 140, and a half pixel motion 
5 estimation unit 150. 

Referring to FIG. 1 , the candidate vector estimation unit 1 10 receives video data 
and estimates a candidate vector for a macro block to be estimated at present. At this 
time, as a candidate motion vector, the candidate vector estimation unit 1 10 selects the 
best matching motion vector among a zero motion vector, a previous motion vector, and 
10 the motion vectors of neighboring blocks. 

The algorithm selecting unit 120 selects a motion estimation algorithm (the 
OPGS or the HSBMA) by comparing the absolute difference (SAD) between the 
candidate vector estimated by the candidate vector estimation unit 110 and a 
predetermined threshold. 
15 The motion estimation unit 130 performs full pixel motion estimation of a macro 

block input by a motion algorithm (the OPGS or the HSBMA) selected by the algorithm 
selecting unit 120. 

A memory 140 stores a full pixel motion estimated value estimated by the motion 
estimation unit 130 and applies the estimated value to the candidate vector estimation 
20 unit 110. 

With video data input, the half pixel motion estimation unit 150 estimates the half 
pixel motion of a 16 x 16 macro block and 8x8 sub-block, referring to the location of the 
full pixel motion estimated value estimated by the motion estimation unit 130. 

FIG. 2 is a flowchart for a method for hybrid-type high speed motion estimation 
25 according to the present invention. 

Referring to FIGS. 3 through 6, the flowchart of the method for high speed motion 
estimation shown in FIG. 2 will now be explained. 
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First, input video data (or a frame) is divided into macro blocks that are desired to 
be searched, and a search area of the previous or next frame for a macro block is set in 
step 210. 

Then, a candidate vector for the macro block of which a motion vector is desired 
5 to be estimated is estimated in step 220. For example, as shown in FIG. 3, the macro 
block distribution by motion size, obtained by performing the FSBMA with video data, 
shows that a good many motion vectors have lengths between "0" and "1 Therefore, 
to obtain these motion vectors, a motion estimation algorithm, which can reduce 
calculations referring to the distribution degree, as shown in FIG. 3, is applied instead of 

10 applying only one motion estimation algorithm to all macro blocks. 

Therefore, the best matching value among (1) a zero motion vector, (2) motion 
vectors of neighboring blocks, and (3) the previous motion vector , for example a vector 
value having the minimum SAD is set as a candidate motion vector. 
Here, three candidate motion vectors are set as follows. 

15 A first candidate motion vector (1) is set to a motion vector having a length of "0" 

(zero motion vector). 

A second candidate motion vector (2) is set to a median value of motion vectors 
of three macro blocks 420, 430, and 440, of which motion vectors have already been 
calculated, centered on the current macro block, as shown in (b) of FIG. 4. However, if 

20 the current frame is a bi-directional (B)-type, one among a forward motion vector, a 
backward motion vector, and a bi-directional motion vector in the neighboring macro 
blocks is selected. Therefore, if one of the three direction motion vectors is known, the 
remaining direction motion vectors can be estimated by scaling the motion vector that is 
already known. For example, if a forward motion vector is known, the forward motion 

25 vector is appropriately scaled according to the number of intervals of a reference frame, 
and by inverting the sign of the scaled motion vector, a backward motion vector is 
estimated. Likewise, a backward motion vector can be appropriately changed into a 
forward motion vector. Therefore, after obtaining a median by calculating the three 
types of motion vectors (forward, backward, and bi-directional) for each of the 
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neighboring macro blocks 420, 430, and 440, the motion vector best matching the 
macro block, desired to be estimated is set as the second candidate motion vector (2). 

As shown in (a) of FIG. 4, if the current frame is a predictive (P)-type frame, a 
third candidate motion vector (3) is set to a motion vector 410 of a macro block at the 
5 same location in the current frame as the location in the previous P-type frame, or is set 
to a median of the motion vectors of the five macro blocks including the 4 neighboring 
macro blocks. At this time, if the current frame is a B-type frame, the motion vector of 
a macro block at the same location of the current frame as the previous or next P-type 
frame, which is used to estimate the motion vector of the current frame, is estimated by 

10 scaling. After scaling the four neighboring macro blocks, a median is set as the third 
candidate motion vector (3). 

At this time, if one directional component of a macro block is known, motion 
vectors of the remaining directions (forward, backward, and bi-directional) can be 
estimated through scaling and inverting the sign, as in the method used to estimate the 

15 second candidate motion vector. 

Then, a motion estimation algorithm is selected by comparing the value best 
matching the search area among the candidate motion vectors (for example, using the 
minimum SAD), with the predetermined threshold (T), in step 230. Here, if moving 
pictures are encoded real time in a multitasking environment, a shortage of CPU 

20 processing power may occur. In this case, if a constant frame rate is desired, a target 
encoding time for each frame is calculated in advance. Therefore, a threshold (T) is 
adjusted by estimating an encoding time for each slice (a group of a series of macro 
blocks) for the current frame based on the target encoding time calculated in advance. 
Then, if the minimum SAD value corresponding to the value best matching the 

25 macro block to be estimated, among the candidate motion vectors, is within the range of 
the threshold (T), the OPGS algorithm is selected. At this time, according to the known 
OPGS algorithm, a motion vector is searched for in a more limited range of 1/2 or 1/4 of 
the absolute value which a motion vector that is defined by °f code" can be, centered on 
the location corresponding to the estimated candidate motion vector, in step 240. At 
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this time, the f code indicates a maximum search range and a minimum search range 
within which a motion vector can be. Referring to FIG. 5, ® is a starting point 
corresponding to an estimated location, like (a) and (b) of FIG. 4. Centered on the 
starting point (©), matching for each of four locations indicated by ® is performed, and 
5 then matching for each of four locations indicated by ® or ® is performed, and then 
matching is performed repeatedly until best matching neighboring values do not exist. 
In this way, a motion vector which is the best matching location corresponding to the 
result (®) is finally converged. 

Here, for H.263 and MPEG-4 standards, the OPGS usually performs 8x8 

10 sub-block motion estimation (advanced prediction mode or 4MV mode) in a range within 
± 2 of the motion vector of a macro block. However, in the present invention, 16x16 
macro block OPGS is performed and then OPGS for each 8x8 sub-block is performed 
in a range within ±2 of the motion vector. Also, an unrestricted motion vector in an 
extended area is estimated through repetitive padding as defined in the standards. 

15 The, if estimation fails because the best matching value among the candidate 

motion vectors, that is, SAD, is outside of the threshold, the HSBMA algorithm is 
performed. The HSBMA algorithm performs motion estimation for the entire search 
area indicated by the f code in step 250. 

Referring to FIG. 6, the embodiment will now be explained. From a search area 

20 formed of a low resolution or sub-sampled image (for example: [-2, +2]), a motion vector 
is searched for in stage 1 . Using the search result of stage 1 , a precise motion vector 
is searched for in a restricted search area in a high resolution image or the original 
image in stage 2. This process is continuously repeated until the highest resolution (or 
the original image) is reached, and then the best matching block location is set to the 

25 motion vector. Also, HSBMA uses a spiral search, and, if the matching degree is good 
enough when the motion vector which is calculated in each stage (stage 1 , and stage 2) 
and compared to the preset threshold, the motion vector is selected as the final 
estimated value. Here, the threshold determines the range of allowable error, 
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determined the accuracy and calculation amount of HSBMA, and is selected depending 
on an estimated encoding time. Here, when a motion vector for a 8 x 8 sub-block of is 
estimated, HSBMA estimates the motion of each of four sub-blocks in stage 2, and 
estimates the motion of a macro block by adding the matching values of the four blocks. 

5 Also, when necessary, HSBMA estimates an unrestricted motion vector for an extended 
search area after repetitive padding. 

Then, motion vectors, by pixel unit, estimated by the OPGS algorithm or the 
HSBMA algorithm are stored in units of 16 x 16 macro blocks, and a motion vector by 
half pixel is estimated on the basis of pixel unit motion estimation in steps 260 and 270. 

10 Then, motion vectors of 16 x 16 macro block, 8x8 sub-block, and half pixel are 

extracted in step 280. 

[Effect of the Invention] 

According to the present invention as described above, a motion vector is 
15 estimated, and then OPGS is performed centered on the estimated location, and if the 
estimation fails, the estimation is compensated by HSBMA to prevent errors due to the 
inaccurate estimation. By doing do, high accuracy can be maintained while the 
amount of calculation can be reduced. The present invention is particularly effective in 
a real time encoder. 
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What is claimed is: 

1 . An adaptive motion estimation method, the motion estimation method 
comprising the steps of: 

(a) inputting a frame in units of macro blocks and a search area, and estimating 
5 candidate motion vectors for a macro block desired to be estimated; and 

(b) if an error of the candidate motion vectors estimated in step (a) is in a 
threshold range, estimating motion in a restricted search area centered on the 
estimated location, and otherwise, estimating motion in the whole of the search area. 

2. The motion estimation method of claim 1, wherein a zero motion vector, a 
10 median of motion vectors of neighboring macro blocks, and a value estimated from the 

previous or next frame are generated, and a candidate motion vector is obtained by 
selecting a value best matching the macro block desired to be estimated, among the 
three values. 

3. The motion estimation method of claim 1, wherein step (b) further 
15 comprises the sub-steps of: 

(b-1) if an error of the estimated candidate motion vector is within the threshold 
range, performing a one-pixel greedy search (OPGS) algorithm; and 

(b-2) otherwise, performing a hierarchical search block matching algorithm 
(HSBMA). 

20 4. The motion estimation method of claim 1 , wherein the threshold in step (b) 

is adjusted by estimating an encoding time for the current frame at each slice unit 
corresponding to the macro block group, based on a target encoding time calculated in 
advance. 

5. The motion estimation method of claim 3, wherein by using a spiral search 
25 in step (b-2), the HSBMA compares a motion vector matching degree with an allowable 

error range selected according to an estimated encoding time among preset thresholds 
at each search stage, and selects the compared value within said range as a motion 
vector. 

6. An adaptive motion estimation apparatus, comprising: 
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a vector estimation unit for receiving video data, and estimating a motion vector 
for a macro block desired to be estimated, by selecting from among a zero motion 
vector, the previous motion vector, and motion vectors of neighboring blocks, as a 
candidate motion vector; 

an algorithm selecting unit for selecting a motion estimation algorithm by 
comparing an error between the candidate vector and a preset threshold; and 

a motion estimation unit for estimating motion within a restricted search area, 
centered on an estimated location, if an error in the candidate motion vector is in a 
threshold range, and otherwise, estimating motion in a whole search area. 

7. The motion estimation apparatus of claim 6, further comprising: a half 
pixel motion estimation unit for estimating half pixel motion, referring to the location of 
the estimated value estimated by the motion estimation unit. 
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